EDA

Dataset statistics

Number of variables	15
Number of observations	6362620
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	728.1 MiB
Average record size in memory	120.0 B

Variable types

Numeric	9
Categorical	6

Warnings

`name_orig` has a high cardinality: 6353307 distinct values	High cardinality
`name_dest` has a high cardinality: 2722362 distinct values	High cardinality
`step` is highly correlated with `days`	High correlation
`amount` is highly correlated with `error_orig`	High correlation
`oldbalance_orig` is highly correlated with `newbalance_orig`	High correlation
`newbalance_orig` is highly correlated with `oldbalance_orig`	High correlation
`oldbalance_dest` is highly correlated with `newbalance_dest`	High correlation
`newbalance_dest` is highly correlated with `oldbalance_dest`	High correlation
`error_orig` is highly correlated with `amount`	High correlation
`days` is highly correlated with `step`	High correlation
`dest_type` is highly correlated with `type`	High correlation
`type` is highly correlated with `dest_type`	High correlation
`amount` is highly skewed (γ1 = 30.99394956)	Skewed
`error_orig` is highly skewed (γ1 = -30.07474652)	Skewed
`error_dest` is highly skewed (γ1 = -49.20227538)	Skewed
`name_orig` is uniformly distributed	Uniform
`oldbalance_orig` has 2102449 (33.0%) zeros	Zeros
`newbalance_orig` has 3609566 (56.7%) zeros	Zeros
`oldbalance_dest` has 2704388 (42.5%) zeros	Zeros
`newbalance_dest` has 2439433 (38.3%) zeros	Zeros
`error_orig` has 414047 (6.5%) zeros	Zeros
`error_dest` has 719354 (11.3%) zeros	Zeros

Reproduction

Analysis started	2021-01-22 02:37:16.825966
Analysis finished	2021-01-22 03:27:44.182787
Duration	50 minutes and 27.36 seconds
Software version	pandas-profiling v2.10.0
Download configuration	config.yaml

step
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	743
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	243.3972456
Minimum	1
Maximum	743
Zeros	0
Zeros (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	1
5-th percentile	16
Q1	156
median	239
Q3	335
95-th percentile	490
Maximum	743
Range	742
Interquartile range (IQR)	179

Descriptive statistics

Standard deviation	142.331971
Coefficient of variation (CV)	0.5847723161
Kurtosis	0.329070555
Mean	243.3972456
Median Absolute Deviation (MAD)	92
Skewness	0.3751768885
Sum	1548644183
Variance	20258.38998
Monotocity	Increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
19	51352	0.8%
18	49579	0.8%
187	49083	0.8%
235	47491	0.7%
307	46968	0.7%
163	46352	0.7%
139	46054	0.7%
403	45155	0.7%
43	45060	0.7%
355	44787	0.7%
Other values (733)	5890739	92.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2708	< 0.1%
2	1014	< 0.1%
3	552	< 0.1%
4	565	< 0.1%
5	665	< 0.1%

Value	Count	Frequency (%)
743	8	< 0.1%
742	14	< 0.1%
741	22	< 0.1%
740	6	< 0.1%
739	10	< 0.1%

type
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

CASH_OUT	2237500
PAYMENT	2151495
CASH_IN	1399284
TRANSFER	532909
DEBIT	41432

Length

Max length	8
Median length	7
Mean length	7.422395963
Min length	5

Characters and Unicode

Total characters	47225885
Distinct characters	18
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	PAYMENT
2nd row	PAYMENT
3rd row	TRANSFER
4th row	CASH_OUT
5th row	PAYMENT

Value	Count	Frequency (%)
CASH_OUT	2237500	35.2%
PAYMENT	2151495	33.8%
CASH_IN	1399284	22.0%
TRANSFER	532909	8.4%
DEBIT	41432	0.7%

Histogram of lengths of the category

Value	Count	Frequency (%)
cash_out	2237500	35.2%
payment	2151495	33.8%
cash_in	1399284	22.0%
transfer	532909	8.4%
debit	41432	0.7%

Most occurring characters

Value	Count	Frequency (%)
A	6321188	13.4%
T	4963336	10.5%
S	4169693	8.8%
N	4083688	8.6%
C	3636784	7.7%
H	3636784	7.7%
_	3636784	7.7%
E	2725836	5.8%
O	2237500	4.7%
U	2237500	4.7%
Other values (8)	9576792	20.3%

Most occurring categories

Value	Count	Frequency (%)
Uppercase Letter	43589101	92.3%
Connector Punctuation	3636784	7.7%

Most frequent character per category

Value	Count	Frequency (%)
A	6321188	14.5%
T	4963336	11.4%
S	4169693	9.6%
N	4083688	9.4%
C	3636784	8.3%
H	3636784	8.3%
E	2725836	6.3%
O	2237500	5.1%
U	2237500	5.1%
P	2151495	4.9%
Other values (7)	7425297	17.0%

Value	Count	Frequency (%)
_	3636784	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	43589101	92.3%
Common	3636784	7.7%

Most frequent character per script

Value	Count	Frequency (%)
A	6321188	14.5%
T	4963336	11.4%
S	4169693	9.6%
N	4083688	9.4%
C	3636784	8.3%
H	3636784	8.3%
E	2725836	6.3%
O	2237500	5.1%
U	2237500	5.1%
P	2151495	4.9%
Other values (7)	7425297	17.0%

Value	Count	Frequency (%)
_	3636784	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	47225885	100.0%

Most frequent character per block

Value	Count	Frequency (%)
A	6321188	13.4%
T	4963336	10.5%
S	4169693	8.8%
N	4083688	8.6%
C	3636784	7.7%
H	3636784	7.7%
_	3636784	7.7%
E	2725836	5.8%
O	2237500	4.7%
U	2237500	4.7%
Other values (8)	9576792	20.3%

amount
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	5236933
Distinct (%)	82.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	179861.9036
Minimum	0
Maximum	92445520
Zeros	16
Zeros (%)	< 0.1%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	2224.0995
Q1	13389.57
median	74871.94
Q3	208721.4775
95-th percentile	518634.205
Maximum	92445520
Range	92445520
Interquartile range (IQR)	195331.9075

Descriptive statistics

Standard deviation	603858.2319
Coefficient of variation (CV)	3.357343717
Kurtosis	1797.956717
Mean	179861.9036
Median Absolute Deviation (MAD)	68393.655
Skewness	30.99394956
Sum	1.144392945 × 10¹²
Variance	3.646447642 × 10¹¹
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10000000	3207	0.1%
10000	88	< 0.1%
5000	79	< 0.1%
15000	68	< 0.1%
500	65	< 0.1%
100000	42	< 0.1%
21500	37	< 0.1%
120000	29	< 0.1%
135000	20	< 0.1%
0	16	< 0.1%
Other values (5236923)	6358969	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	16	< 0.1%
0.01	1	< 0.1%
0.02	3	< 0.1%
0.03	2	< 0.1%
0.04	1	< 0.1%

Value	Count	Frequency (%)
92445520	1	< 0.1%
73823490	1	< 0.1%
71172480	1	< 0.1%
69886730	1	< 0.1%
69337320	1	< 0.1%

name_orig
Categorical

HIGH CARDINALITY
UNIFORM

Distinct	6353307
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

C400299098	3
C1999539787	3
C1784010646	3
C1065307291	3
C1462946854	3
Other values (6353302)	6362605

Length

Max length	11
Median length	11
Mean length	10.48232332
Min length	5

Characters and Unicode

Total characters	66695040
Distinct characters	11
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	6344009 ?
Unique (%)	99.7%

Sample

1st row	C1231006815
2nd row	C1666544295
3rd row	C1305486145
4th row	C840083671
5th row	C2048537720

Value	Count	Frequency (%)
C400299098	3	< 0.1%
C1999539787	3	< 0.1%
C1784010646	3	< 0.1%
C1065307291	3	< 0.1%
C1462946854	3	< 0.1%
C363736674	3	< 0.1%
C724452879	3	< 0.1%
C1677795071	3	< 0.1%
C1530544995	3	< 0.1%
C2098525306	3	< 0.1%
Other values (6353297)	6362590	> 99.9%

Histogram of lengths of the category

Value	Count	Frequency (%)
c724452879	3	< 0.1%
c1530544995	3	< 0.1%
c1976208114	3	< 0.1%
c1462946854	3	< 0.1%
c1065307291	3	< 0.1%
c1999539787	3	< 0.1%
c1784010646	3	< 0.1%
c363736674	3	< 0.1%
c1832548028	3	< 0.1%
c1677795071	3	< 0.1%
Other values (6353297)	6362590	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
1	8803448	13.2%
C	6362620	9.5%
2	6136135	9.2%
3	5699596	8.5%
4	5693146	8.5%
7	5669437	8.5%
5	5668010	8.5%
6	5667725	8.5%
0	5667074	8.5%
9	5665212	8.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	60332420	90.5%
Uppercase Letter	6362620	9.5%

Most frequent character per category

Value	Count	Frequency (%)
1	8803448	14.6%
2	6136135	10.2%
3	5699596	9.4%
4	5693146	9.4%
7	5669437	9.4%
5	5668010	9.4%
6	5667725	9.4%
0	5667074	9.4%
9	5665212	9.4%
8	5662637	9.4%

Value	Count	Frequency (%)
C	6362620	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	60332420	90.5%
Latin	6362620	9.5%

Most frequent character per script

Value	Count	Frequency (%)
1	8803448	14.6%
2	6136135	10.2%
3	5699596	9.4%
4	5693146	9.4%
7	5669437	9.4%
5	5668010	9.4%
6	5667725	9.4%
0	5667074	9.4%
9	5665212	9.4%
8	5662637	9.4%

Value	Count	Frequency (%)
C	6362620	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	66695040	100.0%

Most frequent character per block

Value	Count	Frequency (%)
1	8803448	13.2%
C	6362620	9.5%
2	6136135	9.2%
3	5699596	8.5%
4	5693146	8.5%
7	5669437	8.5%
5	5668010	8.5%
6	5667725	8.5%
0	5667074	8.5%
9	5665212	8.5%

oldbalance_orig
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	1834373
Distinct (%)	28.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	833883.104
Minimum	0
Maximum	59585040
Zeros	2102449
Zeros (%)	33.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	14208
Q3	107315.175
95-th percentile	5823702.1
Maximum	59585040
Range	59585040
Interquartile range (IQR)	107315.175

Descriptive statistics

Standard deviation	2888242.673
Coefficient of variation (CV)	3.46360618
Kurtosis	32.96487855
Mean	833883.104
Median Absolute Deviation (MAD)	14208
Skewness	5.249136421
Sum	5.305681315 × 10¹²
Variance	8.341945738 × 10¹²
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2102449	33.0%
184	918	< 0.1%
133	914	< 0.1%
195	912	< 0.1%
164	909	< 0.1%
109	908	< 0.1%
181	908	< 0.1%
157	902	< 0.1%
146	899	< 0.1%
128	898	< 0.1%
Other values (1834363)	4252003	66.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2102449	33.0%
0.05	1	< 0.1%
0.18	1	< 0.1%
0.21	1	< 0.1%
0.44	1	< 0.1%

Value	Count	Frequency (%)
59585040	1	< 0.1%
57316256	1	< 0.1%
50399044	1	< 0.1%
49585040	1	< 0.1%
47316256	1	< 0.1%

newbalance_orig
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	2663280
Distinct (%)	41.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	855113.6686
Minimum	0
Maximum	49585040
Zeros	3609566
Zeros (%)	56.7%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	144258.4
95-th percentile	5980262.375
Maximum	49585040
Range	49585040
Interquartile range (IQR)	144258.4

Descriptive statistics

Standard deviation	2924048.503
Coefficient of variation (CV)	3.419485164
Kurtosis	32.06698456
Mean	855113.6686
Median Absolute Deviation (MAD)	0
Skewness	5.176884001
Sum	5.44076333 × 10¹²
Variance	8.550059647 × 10¹²
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	3609566	56.7%
944.55	4	< 0.1%
9226.55	4	< 0.1%
2987.95	4	< 0.1%
5317.9	4	< 0.1%
10093.85	4	< 0.1%
19220.18	4	< 0.1%
31285.61	4	< 0.1%
2043.14	4	< 0.1%
23623.99	4	< 0.1%
Other values (2663270)	2753018	43.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	3609566	56.7%
0.01	1	< 0.1%
0.03	1	< 0.1%
0.05	1	< 0.1%
0.12	1	< 0.1%

Value	Count	Frequency (%)
49585040	1	< 0.1%
47316256	1	< 0.1%
43686616	1	< 0.1%
43673804	1	< 0.1%
41690844	1	< 0.1%

name_dest
Categorical

HIGH CARDINALITY

Distinct	2722362
Distinct (%)	42.8%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

C1286084959	113
C985934102	109
C665576141	105
C2083562754	102
C248609774	101
Other values (2722357)	6362090

Length

Max length	11
Median length	11
Mean length	10.48175201
Min length	2

Characters and Unicode

Total characters	66691405
Distinct characters	12
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	2262704 ?
Unique (%)	35.6%

Sample

1st row	M1979787155
2nd row	M2044282225
3rd row	C553264065
4th row	C38997010
5th row	M1230701703

Value	Count	Frequency (%)
C1286084959	113	< 0.1%
C985934102	109	< 0.1%
C665576141	105	< 0.1%
C2083562754	102	< 0.1%
C248609774	101	< 0.1%
C1590550415	101	< 0.1%
C1789550256	99	< 0.1%
C451111351	99	< 0.1%
C1360767589	98	< 0.1%
C1023714065	97	< 0.1%
Other values (2722352)	6361596	> 99.9%

Histogram of lengths of the category

Value	Count	Frequency (%)
c1286084959	113	< 0.1%
c985934102	109	< 0.1%
c665576141	105	< 0.1%
c2083562754	102	< 0.1%
c248609774	101	< 0.1%
c1590550415	101	< 0.1%
c1789550256	99	< 0.1%
c451111351	99	< 0.1%
c1360767589	98	< 0.1%
c1023714065	97	< 0.1%
Other values (2722352)	6361596	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
1	8799996	13.2%
2	6133780	9.2%
3	5704404	8.6%
4	5691070	8.5%
8	5675627	8.5%
9	5668861	8.5%
7	5665128	8.5%
0	5664751	8.5%
6	5662897	8.5%
5	5662271	8.5%
Other values (2)	6362620	9.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	60328785	90.5%
Uppercase Letter	6362620	9.5%

Most frequent character per category

Value	Count	Frequency (%)
1	8799996	14.6%
2	6133780	10.2%
3	5704404	9.5%
4	5691070	9.4%
8	5675627	9.4%
9	5668861	9.4%
7	5665128	9.4%
0	5664751	9.4%
6	5662897	9.4%
5	5662271	9.4%

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Most occurring scripts

Value	Count	Frequency (%)
Common	60328785	90.5%
Latin	6362620	9.5%

Most frequent character per script

Value	Count	Frequency (%)
1	8799996	14.6%
2	6133780	10.2%
3	5704404	9.5%
4	5691070	9.4%
8	5675627	9.4%
9	5668861	9.4%
7	5665128	9.4%
0	5664751	9.4%
6	5662897	9.4%
5	5662271	9.4%

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	66691405	100.0%

Most frequent character per block

Value	Count	Frequency (%)
1	8799996	13.2%
2	6133780	9.2%
3	5704404	8.6%
4	5691070	8.5%
8	5675627	8.5%
9	5668861	8.5%
7	5665128	8.5%
0	5664751	8.5%
6	5662897	8.5%
5	5662271	8.5%
Other values (2)	6362620	9.5%

oldbalance_dest
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	3532215
Distinct (%)	55.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1100701.666
Minimum	0
Maximum	356015900
Zeros	2704388
Zeros (%)	42.5%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	132705.665
Q3	943036.6875
95-th percentile	5147229.7
Maximum	356015900
Range	356015900
Interquartile range (IQR)	943036.6875

Descriptive statistics

Standard deviation	3399180.111
Coefficient of variation (CV)	3.088193844
Kurtosis	948.6741239
Mean	1100701.666
Median Absolute Deviation (MAD)	132705.665
Skewness	19.92175787
Sum	7.003346437 × 10¹²
Variance	1.155442542 × 10¹³
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2704388	42.5%
10000000	615	< 0.1%
20000000	219	< 0.1%
30000000	86	< 0.1%
40000000	31	< 0.1%
102	21	< 0.1%
198	19	< 0.1%
160	18	< 0.1%
125	18	< 0.1%
132	18	< 0.1%
Other values (3532205)	3657187	57.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2704388	42.5%
0.01	1	< 0.1%
0.03	1	< 0.1%
0.13	1	< 0.1%
0.33	1	< 0.1%

Value	Count	Frequency (%)
356015900	1	< 0.1%
355553400	1	< 0.1%
355381440	1	< 0.1%
355380480	1	< 0.1%
355185540	1	< 0.1%

newbalance_dest
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	3474507
Distinct (%)	54.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1224996.398
Minimum	0
Maximum	356179260
Zeros	2439433
Zeros (%)	38.3%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	214661.445
Q3	1111909.2
95-th percentile	5515715.975
Maximum	356179260
Range	356179260
Interquartile range (IQR)	1111909.2

Descriptive statistics

Standard deviation	3674128.939
Coefficient of variation (CV)	2.999297748
Kurtosis	862.1564998
Mean	1224996.398
Median Absolute Deviation (MAD)	214661.445
Skewness	19.35230197
Sum	7.794186583 × 10¹²
Variance	1.349922346 × 10¹³
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2439433	38.3%
10000000	53	< 0.1%
971418.94	32	< 0.1%
19169204	29	< 0.1%
1254956.1	25	< 0.1%
16532032	25	< 0.1%
1412484.1	22	< 0.1%
1178808.1	21	< 0.1%
4743010.5	21	< 0.1%
7364725	21	< 0.1%
Other values (3474497)	3922938	61.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2439433	38.3%
0.01	1	< 0.1%
0.33	1	< 0.1%
1.39	1	< 0.1%
1.64	1	< 0.1%

Value	Count	Frequency (%)
356179260	1	< 0.1%
356015900	1	< 0.1%
355553400	2	< 0.1%
355381440	1	< 0.1%
355380480	1	< 0.1%

is_fraud
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

0	6354407
1	8213

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	6362620
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	1
4th row	1
5th row	0

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Histogram of lengths of the category

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring characters

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	6362620	100.0%

Most frequent character per category

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	6362620	100.0%

Most frequent character per script

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6362620	100.0%

Most frequent character per block

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

is_flagged_fraud
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

0	6362604
1	16

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	6362620
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Histogram of lengths of the category

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring characters

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	6362620	100.0%

Most frequent character per category

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	6362620	100.0%

Most frequent character per script

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6362620	100.0%

Most frequent character per block

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

error_orig
Real number (ℝ)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	4664191
Distinct (%)	73.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	-201092.4681
Minimum	-92445520
Maximum	4.24
Zeros	414047
Zeros (%)	6.5%
Memory size	48.5 MiB

Quantile statistics

Minimum	-92445520
5-th percentile	-700716.6235
Q1	-249641.0825
median	-68677.255
Q3	-2954.1975
95-th percentile	2.728484105 × 10¹²
Maximum	4.24
Range	92445524.24
Interquartile range (IQR)	246686.885

Descriptive statistics

Standard deviation	606650.4605
Coefficient of variation (CV)	-3.016773658
Kurtosis	1753.268489
Mean	-201092.4681
Median Absolute Deviation (MAD)	68677.255
Skewness	-30.07474652
Sum	-1.279474959 × 10¹²
Variance	3.680247813 × 10¹¹
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	414047	6.5%
1.818989404 × 10¹²	49996	0.8%
-1.818989404 × 10¹²	49909	0.8%
3.637978807 × 10¹²	42006	0.7%
-3.637978807 × 10¹²	41919	0.7%
-9.094947018 × 10¹³	35430	0.6%
9.094947018 × 10¹³	35357	0.6%
-7.275957614 × 10¹²	19682	0.3%
7.275957614 × 10¹²	19631	0.3%
-4.547473509 × 10¹³	16651	0.3%
Other values (4664181)	5637992	88.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-92445520	1	< 0.1%
-73823490	1	< 0.1%
-71172480	1	< 0.1%
-69886730	1	< 0.1%
-69337320	1	< 0.1%

Value	Count	Frequency (%)
4.24	1	< 0.1%
2.83	1	< 0.1%
2.53	1	< 0.1%
2	1	< 0.1%
1.98	1	< 0.1%

error_dest
Real number (ℝ)

SKEWED
ZEROS

Distinct	3171375
Distinct (%)	49.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	55567.17192
Minimum	-75885718
Maximum	13191233.77
Zeros	719354
Zeros (%)	11.3%
Memory size	48.5 MiB

Quantile statistics

Minimum	-75885718
5-th percentile	-0.1500000001
Q1	0
median	3500.49
Q3	29353.0175
95-th percentile	456741
Maximum	13191233.77
Range	89076951.77
Interquartile range (IQR)	29353.0175

Descriptive statistics

Standard deviation	441528.7676
Coefficient of variation (CV)	7.945856381
Kurtosis	4190.553496
Mean	55567.17192
Median Absolute Deviation (MAD)	3500.59
Skewness	-49.20227538
Sum	3.535527994 × 10¹¹
Variance	1.949476526 × 10¹¹
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	719354	11.3%
-0.01000000001	128484	2.0%
0.01000000001	128402	2.0%
-0.02000000002	98015	1.5%
0.02000000002	97753	1.5%
0.03000000003	49378	0.8%
-0.03000000003	49230	0.8%
-0.04000000004	43796	0.7%
0.04000000004	43743	0.7%
-0.06000000006	28766	0.5%
Other values (3171365)	4975699	78.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-75885718	1	< 0.1%
-75549130	1	< 0.1%
-72830306.45	1	< 0.1%
-67020175.56	1	< 0.1%
-64707849.24	1	< 0.1%

Value	Count	Frequency (%)
13191233.77	1	< 0.1%
10000000	145	< 0.1%
9996887	1	< 0.1%
9977761	1	< 0.1%
9977760.6	1	< 0.1%

dest_type
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

C	4211125
M	2151495

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	6362620
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	M
2nd row	M
3rd row	C
4th row	C
5th row	M

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Histogram of lengths of the category

Value	Count	Frequency (%)
c	4211125	66.2%
m	2151495	33.8%

Most occurring characters

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Most occurring categories

Value	Count	Frequency (%)
Uppercase Letter	6362620	100.0%

Most frequent character per category

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Most occurring scripts

Value	Count	Frequency (%)
Latin	6362620	100.0%

Most frequent character per script

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6362620	100.0%

Most frequent character per block

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

days
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	31
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	10.49190679
Minimum	1
Maximum	31
Zeros	0
Zeros (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	7
median	10
Q3	14
95-th percentile	21
Maximum	31
Range	30
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	5.921812248
Coefficient of variation (CV)	0.5644171612
Kurtosis	0.3323014534
Mean	10.49190679
Median Absolute Deviation (MAD)	4
Skewness	0.3778477393
Sum	66756016
Variance	35.0678603
Monotocity	Increasing

Histogram with fixed size bins (bins=31)

Value	Count	Frequency (%)
1	574255	9.0%
2	455238	7.2%
8	449637	7.1%
6	441005	6.9%
13	428583	6.7%
17	425766	6.7%
7	420583	6.6%
9	417919	6.6%
11	417859	6.6%
15	401282	6.3%
Other values (21)	1930493	30.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	574255	9.0%
2	455238	7.2%
3	1070	< 0.1%
4	28240	0.4%
5	9789	0.2%

Value	Count	Frequency (%)
31	272	< 0.1%
30	11287	0.2%
29	54890	0.9%
28	14661	0.2%
27	8578	0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	step	type	amount	name_orig	oldbalance_orig	newbalance_orig	name_dest	oldbalance_dest	newbalance_dest	is_fraud	error_orig	error_dest	dest_type	days
0	1	PAYMENT	9839.64	C1231006815	170136.00	160296.36	M1979787155	0.0	0.00	0	1.455192e-11	9839.64	M	1
1	1	PAYMENT	1864.28	C1666544295	21249.00	19384.72	M2044282225	0.0	0.00	0	-1.136868e-12	1864.28	M	1
2	1	TRANSFER	181.00	C1305486145	181.00	0.00	C553264065	0.0	0.00	1	0.000000e+00	181.00	C	1
3	1	CASH_OUT	181.00	C840083671	181.00	0.00	C38997010	21182.0	0.00	1	0.000000e+00	21363.00	C	1
4	1	PAYMENT	11668.14	C2048537720	41554.00	29885.86	M1230701703	0.0	0.00	0	0.000000e+00	11668.14	M	1
5	1	PAYMENT	7817.71	C90045638	53860.00	46042.29	M573487274	0.0	0.00	0	-9.094947e-13	7817.71	M	1
6	1	PAYMENT	7107.77	C154988899	183195.00	176087.23	M408069119	0.0	0.00	0	-1.091394e-11	7107.77	M	1
7	1	PAYMENT	7861.64	C1912850431	176087.23	168225.60	M633326333	0.0	0.00	0	-1.000000e-02	7861.64	M	1
8	1	PAYMENT	4024.36	C1265012928	2671.00	0.00	M1176932104	0.0	0.00	0	-1.353360e+03	4024.36	M	1
9	1	DEBIT	5337.77	C712410124	41720.00	36382.23	C195600860	41898.0	40348.79	0	-3.637979e-12	6886.98	C	1

Last rows

	step	type	amount	name_orig	oldbalance_orig	name_dest	oldbalance_dest	newbalance_dest	is_fraud	error_dest	dest_type	days
6362610	742	TRANSFER	63416.99	C778071008	63416.99	C1812552860	0.00	0.00	1	63416.99	C	31
6362611	742	CASH_OUT	63416.99	C994950684	63416.99	C1662241365	276433.20	339850.16	1	0.03	C	31
6362612	743	TRANSFER	1258818.90	C1531301470	1258818.90	C1470998563	0.00	0.00	1	1258818.90	C	31
6362613	743	CASH_OUT	1258818.90	C1436118706	1258818.90	C1240760502	503464.50	1762283.40	1	0.00	C	31
6362614	743	TRANSFER	339682.12	C2013999242	339682.12	C1850423904	0.00	0.00	1	339682.12	C	31
6362615	743	CASH_OUT	339682.12	C786484425	339682.12	C776919290	0.00	339682.12	1	0.00	C	31
6362616	743	TRANSFER	6311409.50	C1529008245	6311409.50	C1881841831	0.00	0.00	1	6311409.50	C	31
6362617	743	CASH_OUT	6311409.50	C1162922333	6311409.50	C1365125890	68488.84	6379898.00	1	0.34	C	31
6362618	743	TRANSFER	850002.50	C1685995037	850002.50	C2080388513	0.00	0.00	1	850002.50	C	31
6362619	743	CASH_OUT	850002.50	C1280323807	850002.50	C873221189	6510099.00	7360101.50	1	0.00	C	31

Overview

Variables

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows